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Abstract. Let (X„) be a sequence of integrable real random variables, adapted 
to a filtration (Gn)- Define 

1 " 

C„ = v^{-^A:fc-£;(X„+i ISn)} and = V71. {E{X„+i \ Gn) ~ Z} 
" k=i 

where Z is the a.s. limit of | Gn) (assumed to exist). Conditions 

for (C„, D„) ► M{0, U) X A^(0, V) stably are given, where U, V are certain 

random variables. In particular, under such conditions, one obtains 

n 

{ - V Xfc - Z} = C„ + D„ > Ar(0, U + V) stably. 

This CLT has natural applications to Bayesian statistics and urn problems. 
The latter are investigated, by paying special attention to multicolor randomly 
reinforced generalized Polya urns. 



1. Introduction and motivations 

As regards asymptotics in urn models, there is not a unique reference frame- 
work. Rather, there are many (ingenious) disjoint ideas, one for each class of prob- 
lems. Well known examples are martingale methods, exchangeability, branching 
processes, stochastic approximation, dynamical systems and so on; see [l6j . 

Those limit theorems which unify various urn problems, thus, look of some in- 
terest. 

In this paper, we focus on the CLT. While thought for urn problems, our CLT 
is stated for an arbitrary sequence {Xn) of real random variables. Accordingly, 
it potentially applies to every urn situation, but it has generally a broader scope. 
Suppose E'lXnl < oo and define Z„ = E(^Xn+i \ Qn) where {Qn) is some filtration 

which makes (X„) adapted. Under various assumptions, one obtains Z„ "dii:^^ z 
for some random variable Z . Define further X„ ~ ^ and 

Cn = V^(Xn- Zn), D,, = {Zn - Z), Wn = V^I (X„ - Z). 

The limit distribution of C„, Z3„ or Wn is a main goal in various fields, including 
Bayesian statistics, discrete time filtering, gambling and urn problems. See 
[3 J 01, [3> 01 ^^'^ references therein. In fact, suppose the next observation 
Xn+i is to be predicted basing on the available information Qn- If the predictor Zn 
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cannot be evaluated in closed form, one needs some estimate Z„ and C„ reduces 
to the scaled error when Z„ = X„. And Xn is a sound estimate of Z„ under some 
distributional assumptions on (X„), for instance when (X„) is exchangeable, as 
it is usual in Bayesian statistics. Similarly, I?„ and Wn are of interest provided 
Z is regarded as a random parameter. In this case, Z„ is the Bayesian estimate 
(of Z) under quadratic loss and Xn can be often viewed as the the maximum 
likelihood estimate. Note also that, in the trivial case where (Xn) is i.i.d. and 
Gn = . . . , Xn), one obtains C„ — Wn — y/n (X„ — EXi) and D„ = 0. As to 

urn problems, X„ could be the indicator of {black ball at time n} in a multicolor 
urn. Then, Zn becomes the proportion of black balls in the urn at time n and Xn 
the observed frequency of black balls at time n. 

Our main result (Theorem [J) provides conditions for 

iCn,Dn) — > 7V(0, U) X 7V(0, V) stably (1) 

where U, V are certain random variables and JV{0, L) is the Gaussian kernel with 
mean and variance L. A nice consequence is that 

Wn^Cn + Dn — > U + V) stably. 

Stable convergence, in the sense of Aldous and Renyi, is a strong form of convergence 
in distribution; the definition is recalled in Section [2l 

To check the conditions for ([1]), it is fundamental to know something about the 
convergence rate of 

Zn+l ^ Zn = E[Xn+2 I Gn+l) ^ E[Xn+l \ Gn) , 
E{Zn+l — Zn I Gn) = E{^Xn+2 — Xn+1 \ Gn) ■ 

If (Xn) is conditionally identically distributed with respect to (Gn), in the sense 
of [5|, then (Zn) is a (C/„)-martingale and thus only Zn+i — Zn plays a role. This 
happens in particular if {Xn) is exchangeable and Gn — cr{Xi, . . . , X„). 

To illustrate how the CLT works, three applications are given: r-step predictions, 
Poisson-Dirichlet sequences, and randomly reinforced generalized Polya urns. We 
next describe the latter, the main of such applications, and we refer to Subsections 
14.11 and 1 4.21 for the remaining two. 

An urn contains black and red balls. At each time n > 1, a ball is drawn and 
then replaced together with a random number of balls of the same color. Say that 
Bn black balls or i?„ red balls are added to the urn according to whether Xn = 1 
or Xn = 0, where Xn is the indicator of {black ball at time n}. Suppose 

Bn > 0, Rn> 0, EBn = ERn for all n, 

supE{{Bn + Rn)"} < oo for some u > 2, 

n 

m := lim EBn > 0, q := hm EB^ , s := lim ERI . 

n n n 

Letting Gn = cr(Xi, Bi, . . . , X„, i?„, i?„), suppose also that (i3„+i, is 
independent of Gn V cr{Xn+i). Then, as shown in Corollary [71 the conditions for 
dl]) are satisfied with 

U^Zil-Z)i^l^^4±^-l) and V^Zil-Z)^1^^4±^. 

Corollary [7] improves the existing result on this type of urns, obtained in 0, 
under two respects. First, Corollary [7] imphes convergence of the pairs (Cyi,Z?7i) 
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and not only of £)„. Hence, one also gets Wn — > N{0,U + V) stably. Second, 
unlike [1], neither the sequence ((i?n, Rn)) is identically distributed nor the random 
variables _B„ + _R„ have compact support. 

By just the same argument used for two color urns, multicolor versions of Corol- 
lary [7] are easily manufactured. To our knowledge, results of this type were not 
available so far. Briefly, for a d-color urn, let Xn.j be the indicator of {ball of 
color j at time n} where n > 1 and 1 < j < d. Suppose Anj balls of color j are 
added in case Xnj = 1. The random variables Anj are requested exactly the same 
conditions asked above to _B„ and Then, 

(C„, D„) AAd(0, U) X JVdiO, V) stably, 

where Cn and D„ are the vectorial versions of C„ and Z3„ while U, V are certain 
random covariance matrices; see CoroUarv llOl 

A last note is the following. In the previous urn, the n-th reinforce matrix is 

An = diag(A„_i, . . . ,An^d)- 

Since EAn^i = . . . = EAn^d, the leading eigenvalue of the mean matrix EAn has 
multiplicity greater than 1. Even if significant for applications, this particular case 



(th e leading eigenvalue of EAn is not simple) is typically neglected; see [J|, [ll|, 
[l^ . and page 20 of [l6|. Our result, and indeed the result in contribute to fill 
this gap. 

2. Stable convergence 

Stable convergence has been introduced by Renyi in and subsequently in- 
vestigated by various authors. In a sense, it is intermediate between convergence in 
distribution and convergence in probability. We recall here basic definitions. For 
more information, we refer to [H, Q, and references therein. 

Let A, P) be a probability space and S a metric space. A kernel on S (or a 
random probability measure on S) is a measurable collection N — {N{uj) : cj G i7} 
of probability measures on the Borel cr-field on S. Measurability means that 



^H(/) = J fix)Nicj)idx) 

is .4-measurable, as a function oi oj E fl, for each bounded Borel map f : S ^ M.. 

Let (Yn) be a sequence of 5- valued random variables and N a kernel on S. Both 
(Yn) and are defined on (fi. A, P). Say that Yn converges stably to N in case 

P{Yn e-\H)^ E{N{-) I H) weakly 
for all H eA such that P{H) > 0. 

Clearly, if y„ A^ stably, then Yn converges in distribution to the probability law 

E(^N{-)) (just let H = n). Moreover, when S is separable, it is not hard to see that 

P 

Yn ^ Y ii and only if Yn converges stably to the kernel N = Sy- 

We next mention a strong form of stable convergence, introduced in ^7], to be 
used later on. Let JF„ C .4 be a sub-a-field, n > 1. Say that Yn converges to A^ 
stably in strong sense, with respect to the sequence (J^n), in case 

E{f{Yn) I Tn) ^ N{f) for each / e Cb{S) 

where Cb{S) denotes the set of real bounded continuous functions on S. 
Finally, we state a simple but useful fact as a lemma. 
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Lemma 1. Suppose that S is a separable metric space and 

Cn and Dn are S -valued random variables on {Q,A,P), n > 1; 
M and N are kernels on S defined on {Q,A,P); 
{Qn : > 1) is an (increasing) filtration satisfying 

(j{Cn) C Qn and a{Dn) C Qoo for all n, where Qoo = cr(U„^„). 

If Cn — >■ M stably and Dn N stably in strong sense, with respect to (Sn), then 

{Cn, Dn) — > M X N stably. 

(Here, M x N is the kernel on S x S such that {M x N) (w) = M {uj) x N{uj) for 
all Lu ). 

Proof. By standard arguments, since S is separable and (t(C„, Dn) C Qoo, it suffices 
to prove that E{Ih fi{Cn) fiiDn)} ^ E{Ih M{fi) N{f2)} whenever H e U„g„ 
and /i, /2 e Cb{S). Let L„ = E{f2{Dn) \ Gn) - N{f2). Since H e U„e„, there is 
k such that H e Qn for n> k. Thus, 

E{Ih fliCn) f2{Dn)} = E{Ih /i(C„) E{f2{Dn) \ Gn)} 

= E{Ih fliCn) N{f2)} + E{Ih fi{Cn) i„} for aU n>k. 

FinaUy, \E[Ih /i(C„) | < sup |/i| £'|L„| 0, since Dn ^ N stably in strong 
sense, and E{Ih /i(C„) 7V(/2)} ^ E{Ih M{fi) iV(/2)} as C„ ^ M stably. □ 

3. Main result 

In the sequel, {Xn : n > 1) is a sequence of real random variables on the 
probability space (fi. A, P) and {Gn : n > 0) an (increasing) filtration. We assume 
i?|X„| < oo and we let 

— 1 " 
Zn = E{Xn+i I Gn) and Xn = - y^Xk. 

fc=l 

In case sup„ EX^ < oo and 

E{{E{Zn+l I Gn) - ZnY) = 0(^-3), (2) 

the sequence {Zn) is an uniformly intcgrablc quasi-martingale; see e.g. page 532 of 
[ist . Accordingly, 

Zn Z 

for some real random variable Z . Define 

C„ = Vn [Xn - Zn) , Dn = Vn {Zn - Z) . 

Let Af{a, b) denote the one-dimensional Gaussian law with mean a and variance 
6 > (where Af{a,0) — Sa). Note that Af{0,L) is a kernel on M for each real non 
negative random variable L. We are now in a position to state our main result. 

Theorem 2. Suppose a{Xn) C Gn for each n > 1, {X^) is uniformly intcgrablc 
and condition Q holds. Let us consider the following conditions 

(a) ^ £;{maxi<fe<„ fc - Zfel} — > 0, 

(b) ^ ELil^fe - Zk-i + k{Zk-i - Zk)Y ^ U, 
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(c) ^£'{supfc>„|Zfe_i - Zfel } > 0, 

(d) "Efc>„(^fc-i-^fe)'^^. 

where U and V are real non negative random variables. Then, Cn — > A/'(0, U) stably 
under (a)-(b), and Dn A/'(0, V) stably in strong sense, with respect to {Qn), under 
(c)-(d). In particular, 

{Cn,D„) — > 7V(0, U) X 7V(0, V) stably under (a)-(b)-(c)-(d). 

Proof. Since a{Cn) C Qn and Z can be taken CJoo-measurable, Lemma [1] applies. 
Thus, it suffices to prove that C„ A/'(0, U) stably and I?„ — > A/'(0, V) stably in 
strong sense. 

"C",! A/'(0, [/) stably". Suppose conditions (a)-(b) hold. First note that 

n n 

\/nCn = nX„ - nZ„ = ^Xfc + ^((/c - l)Zk-i - kZk) 

k=i fc=i 

n 

Letting 

Xfe - + fc(£'(^fc I - Zfc) 1 " 

i^n,fc = and Q„ = — > k[Zk-i~E{Zu \ Gk 

it follows that Cn = ELi + Qn- By (HD, 



fe=l A;=l 

Hence, it suffices to prove that ^n,k A/'(0, ?7) stably. Letting Tn,k — Gk, 

k = 1, . . . ,n, one obtains fc | Tn.k-i) = a.s.. Thus, by Corollary 7 of Q, 

Sr=i ^n,fe ~^ -'^(Oj t^) stably whenever 



(i) i?{ max |y„,,|} 0; (ii) ^ ^ t/. 



/2 

fc=l 

As to (i), first note that 



\/n max |y„,A;| < niax \Xk-Zk^i\ + y^k \E(Zk \ Gk-i)-Zk-i\ + max k\Zk-i-Zk\ 



k=\ 

Since (^^) is uniformly integrable, ((X„ — Z„-i)'^) is uniformly integrable as well, 
and this implies ^ i?{maxi<fe<„(Xfc — Zk-i)^} — > 0. By condition 



1 1 

Thus, (i) follows from condition (a). 
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As to (ii), write 

n n 1 ^ 



k=l 



k=l 
2 

n 



k=l 



- ^(X, - Zk-i + k{Zk-i - Zk)) k {E{Zk I ^fe-i) - Zk-i) 
= Rn + Sn + Tn Say. 
Then, Rn^Uhy (b) and £;|S'„| = ESn -> by jl]). Further r„ 0, since 

n 

4 n 



„2 1 " 1 " 



k=l 



k=l 



Hence, (ii) holds, and this concludes the proof of Cn — > A/'(0, U) stably. 

" Dn J\f{0,V) stably in strong sense". Suppose conditions (c)-(d) hold. 
We first recall a known result; see Example 6 of [7]. Let (L„) be a (^„)-martingale 

such that Ln ""^^^ L for some real random variable L. Then, 

^/n (L„ — L) — > A/'(0, V) stably in strong sense with respect to {Qn), 
provided 



(c*) V^i;{sup|Lfc_i-Lfc|} -^0; (d*) n^(Lfe_i-Lfe) 



2 P . 



V. 



k>7i 

Next, define Lq = Zq and 



k>n 



Ln — Zn — I Qk) — Zk 



k=Q 



Then, (L„) is a (t/„)-martingale. Also, L„ <^f^i ^ some L, as (Z„) is an 
uniformly integrable quasi martingale. In particular, L„ — L can be written as 
Ln - L ^ J2k>ni^k - ife+i) a.s.. Similarly, Zn - Z ^ J2k>niZk - Zk+i) a.s.. It 
follows that 



E 



Dn - V^{Ln ~L) ^^E {Zn - Z) - (L„ - L) 
= y/nEl '^{{Zk - Lk) - {Zk+i - Lk+i)} 



k>r 



3/2N 



k>r 



k>r 



Thus, Dn A/'(0, V) stably in strong sense if and only if y/n{Ln — L) ^ A/'(0, V) 
stably in strong sense, and to conclude the proof it suffices to check conditions 
(c*)-(d*). In turn, (c*)-(d*) are a straightforward consequence of conditions ([2]), 
(c), (d) and 



Lk-i ~ Lk — {Zk^i — Zk) + {E{Zk I Gk~i) — Zk- 



□ 
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Some remarks on Theorem [2] are in order. 

In real problems, one of the quantities of main interest is 

And, under the assumptions of Theorem [21 one obtains 

Wn^Cn + Dn — > U + V) stably. 

Condition ([2]) trivially holds when (X„) is conditionally identically distributed, 
in the sense of with respect to the filtration {Qn)- In this case, in fact, (Z„) 
is even a (C/„)-martingale. In particular, ^ holds if (X„) is exchangeable and 
Gn = cr{Xi, . . . , Xn)- 

Under (c), condition (a) can be replaced by 

(a*) sup„ i ELi k^E{{Z,^, Zuf] < oo. 

Indeed, (a*) and (c) imply (a) (we omit calculations). Note that, for proving 
Cn — > A/'(0, U) stably under (a*)-(b)-(c), one can rely on more classical versions of 
the martingale CLT, such as Theorem 3.2 of ^1CI|. 

To check conditions (b) and (d), the following simple lemma can help. 



Lemma 3. Let (Yn) be a {Qn)-adapted sequence of real random variables. If 
Yl^=i < '^'^^ E{Yn+i I (y„) Y , for some random variable Y , then 

k>n k—1 

Proof. Let L„ = X]fe=i ~ Then, L„ is a (C/„)-martingale such that 

EY"^ 

supE^L^ <4^— 2^ <c5o. 

k ^ 

Thus, Ln converges a.s. and Abel summation formula yields 



^ Yk - E{Yk I Gk-i) 



n 

k>n 



Since i?(F„+i | Gn) ^ Y and nJ2k>n W — ^ follows that 

^Yk ^ Yk - E{Yk I Gk-i) ^ E{Yk I ^fe-i) a.s. 

" 2^ fcl = " 2^ p + " 2^ p ' ^- 

k>n k>n k>n 

Similarly, Kroneker lemma and E(Yn-^-l \ Qn) Y yield 

- > Ifc = - > E{Yk I Gk-i) + -y^k — > Y. 



n ^ — ' n ^ — ' n 

k=l k=l k=l 



□ 



Our last comment needs a formal remark. 
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Remark 4. As regards _D„, a natural question is whether 

E{f{Dr,) I Gn) ^ AA(0, V)(f) for each / e ^(R). (3) 

This is a strengthening of D„ — > A/'(0, V) stably in strong sense, as E{f{Dn) \ Qn) 
is requested to converge a.s. and not only in probability. Let (X„) be a (non 
necessarily (5„)-adapted) sequence of integrable random variables. Then, for ([3|) 
to be true, it is enough that {Zn) is uniformly integrable and 



Y,^E E{Zk I gk-i)-Zk-i 



k>l 



< oo. 



E{svLpVk \Zk-i - Zk\} < oo, n2\{Zk-i - Zkf' V. 

— K>n 

The proof is essentially the same as that of Theorem [21 up to using Theorem 2.2 of 
[§| instead of Example 6 of ■ 

4. Applications 

This section is split into four subsections, arranged in increasing order of length. 

4.1. r-step predictions. Suppose we are requested to make conditional forecasts 
on a sequence of events An ^ Gn- To fix ideas, for each n, we aim to predict 

conditionally on Qm where J is a given subset of {1, . . . , r} and J'^ = {1, . . . , r} \ J. 
Letting Xn — Ia„ , the predictor can be written as 

K =E{i[ Xn+, n (1 - ^«+^) I ^«}- 

jeJ je.]" 

In the spirit of Section [1] when Z* cannot be evaluated in closed form, one needs 
to estimate it. Under some assumptions, in particular when {Xn) is exchangeable 

and Qn = cr(^i, ■ • ■ ,Xn)^ a reasonable estimate of Z* is Ar^(l — XnY^'^ where 
h =card(J). Usually, under such assumptions, one also has Zn Z and Z* 
Z^{1 — Zy^^ for some random variable Z . So, it makes sense to define 

Q = {xl{i - XnY-" - z:}, K = {K - z\i - zy-'^}. 

Next result is a straightforward consequence of Theorem [2l 

Corollary 5. Let {Xn) be a {Qn)-adapted sequence of indicators satisfying If 
conditions (a)-(h)-(c)-(d) of Theorem\^hold, then 

{C'n,Dn) — > M{0, (T^U) X 7V(0, a^V) stably, where 

= {hz''-\\ - zy-'' - (r - h) z''{i - zy-'^-^y. 

Proof. We just give a sketch of the proof. Let f{x) — — x)'^^'\ Basing on 

-> 0. Thus, C* can be replaced by 



(c), it can be shown that y^E Z* — f{Zn) 



/n 



{/(X„) — /(Z„)} and Z?* by {/(Z„) — /(Z)}. By the mean value theorem, 

V^{f{Xn) - f{Zn)] = V^f'{Mn) {Xn - Zn) - /'(M„) C„ 
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where Mn is between X„ and Z„. By Z„ — ^ Z and Xn Z. Hence, 
/'(M„) ^ /'(Z) as /' is continuous. By TheoremU C„ ^ AA(0, C/) stably. Thus, 

V^{f(Xn) - f{Zn)} ^ r{Z)J^{Q,U)=J^{Q,a^U) stably. 

By a similar argument, it can be seen that ^/n{^f{Zn) — fiZ)} — > A/'(0, u^F) 
stably in strong sense. An application of Lemma [1] concludes the proof. □ 

4.2. Poisson-Dirichlet sequences. Let be a finite set and {¥„) a sequence of 
3^- valued random variables satisfying 

p(y„+i e ^ I Yi, . . . , r„) = ^v^AiSn.y - a) hs^.ym + + « Ey^y hs^.ym) ^(^) 

V " Tin; 9 + n 

a.s. for all ^ C 3^ and n > 1. Here, < a < 1 and > —a are constants, is the 
probability distribution of Yi and Sn.y = J2k=i ^Yk=y}- 

Sequences of this type play a role in various frameworks, mainly in population- 
genetics. They can be regarded as a generalization of those exchangeable sequences 
directed by a two parameter Poisson-Dirichlet process; see jT3|. For a = 0, (y„) 
reduces to a classical Dirichlet sequence (i.e., an exchangeable sequence directed by 
a Dirichlet process). But, for a ^ 0, (F„) may even fail to be exchangeable. 

From the point of view of Theorem [21 however, the only important thing is that 
P(Yn+i € • I Yi, . . . ,Yn) can be written down explicitly. Indeed, the following 
result is available. 

Corollary 6. Let Qn = a{Yi, . . . ,Yn) and Xn = /^(Yn), where A C y. Then, 
condition ^ holds (so that Zn Z) and 

(C„, Dn) — ySaX 7V(0, Z{1 - Z)) stably. 
Proof. Let Q„ = -a Y^y^A ^{Sr.,y^o} + + "E^ej; I{Sr..y^o}) v{A). Since 

Z„ = P{Yn+i e ^ I Fi, . . . , y„) = + ^" and |g„| < c 

for some constant c, then C„ 0. By Lemma [1] and Theorem [21 thus, it suffices 
to check conditions ([21), (c) and (d) with V = Z{1 — Z). On noting that 

Z„+i — Z„ — — — — \ -— — — , 

condition (c) trivially holds. Since S'„+i,j^ = Sn.y + -^{y„+i=a}i one obtains 

<3n+l - Qn = -ai^iA") I{s„.y=0}I{Y,.+i=v} + " f^(^) ^{•S„.„=0}^{y;.+i=y} • 

yeA yeA" 

It follows that 

E{\Qn+l -Qn\\gn} ^{S„.,=0} P{Yn+l = IJ \ Gn) < a.S. 

yey " 
for some constant d, and this implies 



E[Zn+l I Gn) — Zn 



E{Qn+l — Qn I Gn ) 



< a.s. 



1 - {9 + n) 
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Hence, condition ^ holds. To check (d), note that Y.k k'^E{{Zk-i - Zk)^} < oo. 
Since Zk Z (by ([2])) one also obtains 

E{{Xk - Zk-if I Gk^i] = Zk-i - Zl_^ ^ Z{1 - Z), 

E{{Qk - Qk-if I ^fe-i} + 2E{{Xk - Zk-i) [Qk - Qk-i) I ^fe-i} ^ 0. 

Thus, k^E{{Zk-i - Zkf I ^fc-i} ^ Z{1 - Z). Letting ^ = fc2(Zfe_i - Z^f and 
Y = Z(\ — Z), Lemma [3] implies 

n -Zk)'^nJ2^^ Z{1 - Z). 

□ 

As it is clear from the previous proof, all conditions of Remark [J] are satisfied. 
Therefore, Z?„ meets condition ([3]) with V = Z{\ — Z). 

4.3. Two color randomly reinforced generalized Polya urns. An urn con- 
tains & > black balls and r > red balls. At each time n > 1, a ball is drawn and 
then replaced together with a random number of balls of the same color. Say that 
Bn black balls or i?„ red balls are added to the urn according to whether = 1 
or Xn — 0, where X„ is the indicator of {black ball at time n}. 

Urns of this type have some history: see 0, i, |], i, [l5| . (l6j and references 
therein. 

To model such urns, we assume X„, _B„, i?„ random variables on the probability 
space {fl,A,P) such that 

(*) X„ e {0, 1}, B„ > 0, i?„ > 0, 

{Bn,Rn) independent of (Xi, Si, . . . , X„_i, i3„_i, i?„_i, X„), 

Z„ = P(X„+i = 1 I g„) = ■ ^J^f^^ff", a.s., 

b + r + )^^^^[BkXk + Rk{^- Xk)) 

for each n > 1, where 

^0 - {0, f^}, Qn - <j{Xi,Bi,Ri, Xn,Bn, Rn) ■ 

In the particular case _B„ = in Example 3.5 of it is shown that Cn 
converges stably to a Gaussian kernel whenever EB^ < oo and Bn ~ Bi for all n. 
Further, in Corollary 4.1 of Dn is shown to satisfy condition Q. The latter 
result on Dn is extended to Bn ^ Rn in j under the assumptions that Bi + Ri 
has compact support, EBi — ERi, and {Bn,Rn) ~ {Bi,Ri) for all 7i. 

Basing on Theorcm[2l condition ([3]) can be shown to hold more generally. Indeed, 
it is fundamental that EBn = ERn for all n and the three sequences (EBn), {EB^), 
(ER^) approach a limit. But identity in distribution of {Bn,Rn) can be dropped 
and compact support of _B„ + i?„ can be replaced by a moment condition such as 

sup i?{(i?„ + i?„)"} < oo for some u > 2. (4) 

n 

Under these conditions, not only Dn meets ([3|), but the pairs (C„,r'„) converge 
stably as well. In particular, one obtains stable convergence of Wn = C„ + Dn 
which is of potential interest in urn problems. 
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Corollary 7. In addition to (*) and ([4]), suppose EBn = ERn for all n and 
m lim£'B„ > 0, q-.^YiiaEBl, s:=\imERl. 

n n n 

Then, condition ^ holds ( so that Zn — » Z ) and 

(C„, — > 7V(0, U) X 7V(0, V) stably, where 

(1 - Z)q + Zs 



,Al-Z)q + Zs , 
U = Z{1- Z) {- 1) 



id V = Z{1 - Z) 



In particular, Wn — Cn+Dn — > A/'(0, U+V) stably. Moreover, Dn meets condition 
©, that IS, E{f{Dn) I Gn) ^n{0,V){f) for each f G Cb{R). 

It is worth noting that, arguing as in and 15|, one obtains P{Z ~ z) = for 
all z. Thus, Af{0, V) is a non degenerate kernel. In turn, Af{0, U) is non degenerate 
unless q = s = m?, and this happens if and only if both Bn and i?„ converge in 
probability (necessarily to m). In the latter case {q = s = rn^), Cn and 
condition ^ holds with V — Z{1 — Z). Thus, in a sense, randomly reinforced urns 
behave as classical Polya urns (i.e., those urns with _B„ = i?„ ~ m) whenever the 
reinforcements converge in probability. 

The proof of Corollary[7]is deferred to the Appendix as it needs some work. Here, 
to point out the underlying argument, we sketch such a proof under the superfluous 
but simplifying assumption that J5„ V i?„ ^ c for all n and some constant c. Let 



Y,{BkXu + Rk{l~Xk)). 



fc=i 



After some algebra, Zn+i — Zn can be written as 

(1 ^ Zn) Xn+1 Bn+1 ~ Zn (1 — ^n+l) Rn+1 



Zn+1 ^ Zn — 



_ (1 — Zn) Xn+1 Bn+1 
Sn + Bn+1 

By (*) and EBn+i = ERn+i, 

E{Zn+l — Zn I Gn) = Zn{l — Zn) E{ 



Sn+1 

Zn (1 — Xn+l) Rn+1 
Sn + Rn+1 

Bn+1 Rn+1 



Sn 



^Zn[l-Zn)E{ 
= Zn{l-Zn)E{ 



B, 



n+1 



B 



n+1 



Sn + -Sn+1 



-"n+l 



Sn 



Sn{Sn + Bn+l) Sn{Sn + Rn+l) 



Bn+1 Sn + Rn+1 
Rn+1 Rn+1 I 

\Gn} 



Sn + Rn+1 



??2 

-"-n+l 



l^n} 
Gn} 

a.s.. 



Thus, 



E Z, 



n+1 



< 



EBi 



-ERi 



a.s.. Since sup„ + ERl^ < oo 
and E{S^P) = 0{n^P) for all p > (as shown in Lemma [TT|) then 
E{\E{Zn+i I Gn) - Zn\P} = 0{n-^P) for all p > 0. 

In particular, condition ([2|) holds and X]fe ^/k E E{Zk \ Gk-i) — Zk-i < oo. 

To conclude the proof, in view of Lemma [1] Theorem [2] and Remark 21 it suffices 
to check conditions (a), (b) and 

(i) E{supVk\Zk-i- Zk\} <oo; (ii) nY,iZk-i - Zk)^ ^ V. 



k>l 



k>n 
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Conditions (a) and (i) are straightforward consequences of \Zn+i — Zn\ < ^ and 
E{S^P) — 0{n~P) for all p > 0. Condition (b) follows from the same argument 
as (ii). And to prove (ii), it suffices to show that E{Yn+i \ Gn) V where 
y„ = n^{Zn-i ~ Z„)2; see Lemma[3 Write (n + ly^EiYn+i \ Gn) as 

Zn{l - Z^fE{ I Gn] + Zlil - Z^)E{ I Gn). 

Since — m (by Lemma [TT|) and Bn+i < c, then 



f>2 r>2 TPU2 

2 IT r ^n+l \ n ^ ^ 2 7:nr "+1 \ n 1 2 ^^ii+l o,.s. y , 



R2 r2 PR2 



Similarly, "-^^{ (5— ^^T^^Tjjr I Sn} Since Z„ Z, it follows that 

i?(r„+i I Gn) ^ z{\ - z)2X + Z\\ -Z)^ = V. 
This concludes the (sketch of the) proof. 

Remark 8. In order to (C„, I?„) — > A/'(0, fJ) x7V(0, y) stably, some of the assump- 
tions of Corollary[7]can be stated in a different form. We mention two (independent) 
facts. 

First, condition ([4]) can be weakened into uniform integrability of (i3„ + RnY ■ 
Second, (i?„, Rn) independent of Gn-i V cr{Xn) can be replaced by the following 
four conditions: 

(i) {Bn,Rn) conditionally independent of Xn given Gn-i] 

(ii) Condition (|4]) holds for some m > 4; 

(iii) There arc an integer tiq and a constant I > such that 

E[Bn A n^/* I Gn-i) > I and i?(i?„ A n^/* | Gn-i) > I a.s. whenever n > no; 

(iv) There are random variables m, g, s such that 

S(S„ I g„_i) = ^(i?„ I ^ m, ^(^2 I ^ q, E{Rl I ^„_i) ^ s. 

Even if in a different framework, conditions similar to (i)-(iv) arc in 

4.4. The multicolor case. To avoid technicalities, we firstly investigated two color 
urns, but the results in Subsection 14.31 extend to the multicolor case. 

An urn contains aj > balls of color j e {!,. ..,d} where d > 2. Let Xnj 
denote the indicator of {ball of color j at time n}. In case Xn.j = 1, the ball which 
has been drawn is replaced together with Anj more balls of color j. Formally, we 
assume {Xnj, Anj '■ n> 1, 1 < j < d] random variables on the probability space 
{n,A,P) satisfying 

X„,,e{0,l}, Ejtl^nj=l, A„,,>0, 
{An.i,. ■ ■ ,An,d) independent of {Ak,j, Xkj, Xn.j ■ I < k < n, 1 < j < d) , 



Zn,j - P{Xn+l,j -l\Gn) - . 

2^i=l + Z^fe=l 2^t=l Ak,iXk,i 

where Go ~ {0, Gn — <^{Ak,j, X^j : 1 < k < n, 1 < j < d). 
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Note that 

Sn + An+lJ S„ + ^n+1,1 



^n+lj - -^n,i — U - ^n,j) a , A '. ' 



d n d 



where <S'n = ^ + ^ ^ Afe^iXfc^i. 

i = l A;=l i=l 

In addition to (**), as in Subsection 14.31 we ask the moment condition 



d 

sup£^{(^^„j)"} < oo for some u > 2. (5) 

n . 

J = l 

Further, it is fundamental that 

EAn.j = EAn^i for each n > 1 and I < j < d, and (6) 
m lira E An ^1 > 0, 97 := hmSAfj for each 1 < j < d. 

Fix 1 < j < rf. Since EAn^i — EAn^i for all n and i, the same calculation as in 
Subsection 14.31 yields 



E[Zn+lJ I G71) — Zn,j 



< ^2 a-s- 



Also, £^(5,7^) = 0{n-P) for all p > 0; see RemarkfH Thus, 

E{\E{Zn+ij I Gn) - Znj\P} - 0(n-2p) for all p>0. (7) 

In particular, Z„.j meets condition ([2]) so that Zn,j — > .^(j) for some random 
variable . Define 



1 

C„j = \/n ( - ^ Xfcj - Z„j) and = ^/r^ (Z„j - 



Next result is quite expected at this point. 

Corollary 9. Suppose conditions ([5]), ([6]) hold and fix I < j < d. Then, 

(C„j, Dn,j) — » AfiO, Uj) X 7V(0, V;,) staW?/, w/iere 

z 

Uj = l^j - - ^(j)) V,- = { (1 - + ^ }. 

Moreover, £'(/(D„j) | f;„) 7V(0, /or eac/i / £ Cb{^), that is, D„j meets 

condition ([3|. 

Proof. Just repeat the proof of Corollary [7] with ^ri,j in the place of X„. □ 

A vectorial version of Corollary[9]can be obtained with slight effort. Let Afd{0, S) 
denote the d-dimensional Gaussian law with mean vector and covariance matrix 
E and 

Cn = (Cn,l , ■ • ■ J Cn.d) 7 Dn = (Z3„^i, . . . , D^.d) ■ 
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Corollary 10. Suppose conditions (**), jS]) hold. Then, 

(C„, D„) AAd(0, U) X Nd{0, V) stahly, 
where U, V are the d x d matrices with entries Uj_j — Uj, Vjj = Vj, and 

Z ( ^ \ Z ( j\ , ^ — ^ , 
= V,j + Z(^,)Z(^j), V^J ^ 2 — {z^lhZ(h) - Qi- Q]} fori^j. 

h=l 

Moreover, S(/(D„) | Gn) ^ Afd{0,V){f) for each f G Cb(R'^). 
Proof. Given a linear functional (/> : R"^' ^ M, it suffices to see that 
HCn) — > Md{0, U) o (j)-^ stably, and 
E{g o 0(D„) I g„) ^ AAd(0, V){g o for each g e C\{R). 
To this purpose, note that 
1 " 

0(C„) = - ^ (f'iXk^i, . . .,Xk,d) ~ £'(0(X„+i4, . . . ,X„+i^<i) I Q,^ }, 

(?!)(D„) = £;(0(X„+i4, . . .,X.a+\,d) I ^/«) - 0(^(1), ■ • • }, 
and repeat again the proof of Corollary [7] with (/)(X„ i, . . . ,X„ d) in the place of 

A nice consequence of Corollary [TO] is that 

W„ = Cn + Dn ^AA<j(0,U + V) stably 
provided conditions (**)-([5])-(|ni) hold, where Wn = {Wn^\, . . . ,Wn,d) and 

Finally, we briefly mention a possible development of the above material. Sup- 
pose condition ([S]) is turned into 

EAn^j ~ EA„^i whenever n > 1 and 1 < j < do, 

liminf (EAn^i — EAn.j) > whenever j > do, 

n 

m :— limi?A„.i > 0, '■— \imEA^ ■ whenever 1 < j < do, 

for some integer 1 < do < d. Roughly speaking, this means that some colors (those 
labelled from do + 1 to d) are dominated by the others. So far, we dealt with 
do = d but the case do < d is not unusual in applications. The main trouble is that 
condition ([7]) may fail when do < d. It is still possible to get a CLT but one should 
decide how to handle dominated colors. There are essentially two options. 
One is to make assumptions on dominated colors. A classical assumption is 

nm sup — - — — < — tor each j > do. 

n EAji^l 2 

Under this condition, using some ideas from an analogous of Corollary [5] can 
be proved for (C„j , Dn.j) with j = 1, . . . , c?o- 

The other option is to neglect dominated colors, that is, to replace Znj and 
^ ELi ^k,j by 

Z* = ^^l±^LlAh4^ and M: ^k=iXk,, 
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Again, an analogous of Corollary [9] can be shown for 

Cnj = (M*j - Z*^^) and D*^ ^ ^ ^ (Z*^^- - j 
The case do < d will be deepened in a forthcoming paper. 



APPENDIX 

In the notation of Subsection gJl let S"™ = 6 + r + J2l=i {BkXk + Rk{l - Xk)) . 

Lemma 11. Under the assumptions of Corollary^ 
n 1 

— ; > — a.s. and in Lp for all p > 0. 

bn m 

Proof Let Y„ = B„A„ + i?„(l - A„). By (*) and EB^+i = ERn+i, 

E{Yn+l I Gn) = EBn+1 E(^Xn+l \ Gn) + -B-Rri+1 -^(l - Xn+1 \ Gn) 
— Zn EBn+1 + (1 ^ Zn) EBn+1 = EBn+1 > m. 

Since m > 0, Lemma [3] implies = g To conclude the proof, it suffices 

to see that £'(5'"'') = 0{n-P) for all p > 0. Given c> 0, define 

n 

= Y,{Xk{Bk A c - E{Bk A c)) + (1 - Xk){Rk A c - EiRk Ac))}. 
fc=i 

By a classical martingale inequality (see e.g. Lemma 1.5 of [14]) 

P{\Si'''^\> x) <2 exp (-xV2 n) for aU a; > 0. 
Since EBfi = ER^l ^ ^ s-nd both. i^B^^ , (-Rn 

) are uniformly integrable (as 
sup„ {EB'^ + ER'^ < oo), there are c > and an integer no such that 

n 



:= ^ min{i?(_Bfc A c), E{Rk A c)} > n— for all n > rip. 
Fix one such c > and let I — m/ A > 0. For every p > 0, one can write 

^^('5^^)=?' / t-P-^P{Sn<t)dt 
Jb+r 



ib+r 

pb+r+nl poo 

^Jb^^ PiSn<t)dt+p t-P-Ut. 

{O-t-T)'' Jb+r Jb+r+nl 

Clearly, p /fj'^^_|_„; t'^^^ dt — {b + r + n 1)^p — O(n^P). Further, for each n > no 
and t < b + r + nl, since m„ > n2l one obtains 

/"(S^n <t)< P{Si^'> <t-b^r~mn) < P{Si^'> <t-b-r-n2l) 

< P{\Sl''^\ > b + r + n2l - t) < 2 cxp {-{b + r + n2l - tf /2 (? n) . 

Hence, P{Sn < t) dt < n2l exp (—n 272) for every n > no, so that 

EiSnP)=6in~P). ' □ 

Remark 12. As in Subsection SHI let 5„ = J2i=i '^i + J2k=i ^i=i Ak,iXk,i. Under 

conditions (**)-(l5])-(l6l), the previous proof still applies to such S'„. Thus, > ^ 

a.s. and in Lp for all p > 0. 
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Proof of Corollary [3 By Lemma [U it is enough to prove Cn — * A/'(0, U) stably 
and Dn meets condition ([3|). Recall from Subsection 14.31 that 

^ _ ^ Zn) Xn^i Bn^i — Zn {1 ~ X^+l) Rn+1 
^n+l ^ — 5 

and E{ \E{Zn+i \ Gn) - Zn\P} = 0(n-2p) for all p > 0. 
In particular, condition ^ holds and \/k E E{Zk \ Gk-i) — ^fc-i < oo- 
" Dn meets condition (IH])". By Q and Lemma [Tl] 

i?{|Z,_i - Z,r} < E{^-^^^±^} = E{iB, + R,r} E{S^^,) = 0{k-). 

•^fc-i 

Thus, i;{supfc Vfc|^fe-i-^fc|}" < Efe k'iE{\Zk-i-ZkY'} < oo as m > 2. In view 
of Remark [H it remains only to prove that 

(1 - Zk-i)XkBk _ -Z'fc-i(l — X k)Rk\2 
Sk Sk 



{Zk-i~Zk) ^ ^ ) 



k>7i k>n 



^ {l-Zk-ifXuBl ^ Zl_,{l-Xk)Iil 

^t: iSk-,+B,)^ k (Sk-.+Rk? 

converges a.s. to = Z{1 — Z) ■ It is enough to show that 

E{1 - Zk-l^XkBl a.s. , 2 1 A ^k-li^ ^ ^k)Rl a.s. 2/1 
—7^ r7fl2 >Z{1-Z) -2 and n}^— — — ^ >Z (l-Z) 
k>n iSk-i+Bk) m [Sk-i+Rk] 

These two limit relations can be proved by exactly the same argument, and thus we 
just prove the first one. Let [/„ = BnI[B„<^}- Since P(-B„ > 0i) ^ n^EB^^, 
condition ^ yields P{Bn 7^ Um i-o.) = 0. Hence, it suffices to show that 

(1 - Zk^xfXkUl a.s , 2 1 (o\ 



fc> 

Let Y„ = ^^^{^g'^l'l^^yi'^ ■ Since (B^) is uniformly integrable, EU^ — > q. Fur- 
thermore, — m and Z„ Z. Thus, 

-^n+lC^r^+1 



E{Yn+, I a„) < (I - Znfin + 1)^E{ "+:/-+^ I Gn) 

= Zn{l-Zn/^^^±^EUl^,^Z{l-Zf^^ and 
D„ m 

E{Yn+, I Gn) > (1 - Znf{n + l)2i5(^^ii^L^ I g^) 



,2 in + l)' 



{Sn + V" + If 



By Lemma [31 for getting relation ([8]), it suffices that E„ < 00. Since 
EU^ ^ E{B?JiB^<^}} , E{Bll^Bi>^}} ^ EBl , £;i?;^ 

o — 3 I ^31,, u-2 ^ 
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condition (gD implies ^„ < oo. By LemmaHH £^(5,7_i) =0(71-*). Then, 

for some constant c. Hence, condition ([8]) holds. 

"C„ A/'(0, [/) stably". By Theorem[21 it suffices to check conditions (a) and 
(b) withC/ = Z{l-Z) As to (a), since £;{|Zfc_i-Zfc|"} =0(fc-"), 

n 

" fe=i 

We next prove condition (b). After some algebra, one obtains 

E{{X.^ - Z„_i)(Z„_i - Z„) I g„_i} - -Z„_i(l - Z„_i) ^{ ^ ^" I Gn-i] + 

+ - ^" - ^ ^" I a.s.. 

Arguing as in the first part of this proof ("!?„ meets condition (O"), 

nE{ IGn-i}^! and nE{ | ^ 1. 

Thus, n£;{(X„ - Z„_i)(Z„_i - Z„) | Gn-i} ^ -Z{1 - Z). Further, 

E{{X,, - Z„_i)2 I g„_i} = Z„_i - ^ Z(l - Z). 

Thus, Lemma [3] implies 

1 " 2 " 

- V(Xfe - Zk-if + - V fc (Xfe - Zfe_i) (Zfc_i - Zk) ^ -z{i - z). 

n ^ — ^ T}. ^ — ^ 



n ^ — ' n 

k=l k=l 



Finally, write i ELi ^^(^.-1"^.)^ = ^ ELi ^7&Sf^ + %S#" }■ 
By Lemma 13] and the same truncation technique used in the first part of this proof, 
71 ELi kHZk-i - Zkf ^ V. Squaring, 

n 

- y.{^k - Zk-i + k{Zk-i -Zk)Y^V- Z{1 -Z) = U, 

k=l 

that is, condition (b) holds. This concludes the proof. □ 
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